SPECTRAL THEORY OF ELLIPTIC OPERATORS IN EXTERIOR DOMAINS 



FRITZ GESZTESY AND MARK M. MALAMUD 

Abstract. We consider various closed (and self-adjoint) extensions of elliptic differential expressions of the 
type A = So^H |/3|<m( — l) a D a a ai f3(x)DP , a ai g(-) € C°°(fi), on smooth (bounded or unbounded) domains f! 
in 1" with compact boundary dQ. Using the concept of boundary triples and operator- valued Weyl-Titchmarsh 
functions, we prove various trace ideal properties of powers of resolvent differences of these closed realizations 
of A. and derive estimates on eigenvalues of certain self-adjoint realizations in spectral gaps of the Dirichlet 
realization. 

Our results extend classical theorems due to Visik, Povzner, Birman, and Grubb. 



1. Introduction 

Let n be an open domain in 1" (bounded or unbounded) with compact boundary dfl. Throughout we 
assume that dil is an (n — l)-dimensional (not necessarily connected) C^-manifold. Let A be the differential 
expression 

A= ]T {-l) a D a a a Ax)D f \ a a ,p(-)eC x (n), (1.1) 

0<|a|,|/3|<m 

ord(^4) = 2m, which is elliptic in f2. Moreover, we assume that A is properly elliptic in D, (which is automatically 
satisfied if either n > 2 or the symbol of A is real, cf. [11]). In addition to (1.1) we consider its formal adjoint 
A T — J2o^\ a \ \f3\^ m (~ P<if3 : a{x)D ° , which is also properly elliptic in Q (cf. [11]). 

Denote by A = A m - m (A T = the minimal operator associated in L 2 (Vl) with the differential expression 

A (rcsp., A T ), that is, the closure of A defined on C£°(f2). The maximal operators A max and A^^ are 
then defined by A max = (Aj in )* = (A T )* and Aj ax = (A min )* = A*, respectively. We emphasize that 
H 2m (n) C dom(A max ) C fl£?(n), while dom(A max ) ± H 2m (Q). 

After the pioneering work by Vishik [15], nonlocal boundary value problems of the form A max u = /, (du/dn — 
Ku) \ dVL = for elliptic operators (1.1) (with m = 1) in bounded domains were considered by numerous authors 
(see, e.g., [3, 9] and the references therein). Vishik was the first to consider these problems in the framework 
of extension theory of dual pairs of operators. Starting with a formula for the domain dom(A max ) of A max , 
he applied it to an appropriate regularization of the classical Green's formula, using the Calderon operator. 
The latter allowed him to extend the Green's formula from H 2m (il) to dom(A max ). The next fundamental 
contribution to the subject was made by Grubb [9]. Using the theory of Lions and Magenes [11], Grubb 
substantially extended and completed the results of [15]. In particular, Grubb obtained the (regularized) 
Green's formula which (in the special case m = 1) reads as follows: 

(A max u,v) L 2 {n) - (u,Al iax v) L 2 {n) = (rn il u,T] i0 v) 1/2 _ 1/2 - (r^ou, r^u) _ 1/21/2 - 

Here (•, •)«,-« denotes the duality pairing between H s (dil) and H~ s (d£l), u <E dom(A max ), v £ dom(A T iax ), and 
rn,0i rn,i) , and Tq 1 are regularized trace operators, having the properties 

r n ,i : V(A max ) H^idil), f t : V(A max ) -> fT 1 /^), ran((f n>1) f £ „)) = H^ 2 {dQ) x H-V*(m). 
Later, we will use a somewhat different approach (cf. Proposition 2.7). 
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On the other hand, during the past three decades a new approach to the extension theory, based on the concept 
of a boundary triple and the corresponding operator-valued Weyl-Titchmarsh function, was developed in [7] 
(cf. the references therein for the symmetric case) and in [13] (in the case of dual pairs). In this paper we apply 
some results and technique from [7] and [13] to elliptic operators on unbounded domains. The most important 
ingredients from the elliptic theory we need are the regularized Green's formula and a priori coercivity-type 
estimates for the elliptic realizations As of A (see (2.2) below). To obtain the latter on unbounded domains one 
needs additional restrictions on the coefficients of A, since an elliptic realization is not necessarily coercive. Here 
we restrict ourselves to the case of bounded coefficients a a ^(-). Using the formalism of boundary triples and 
the corresponding operator- valued Weyl-Titchmarsh functions in [7, 13], we investigate the resolvent difference 
of two realizations and complement the results of Povzner [14], Birman [5], and Grubb [10] in this direction. 
In addition, assuming A m ; n > 0, we compute the number of negative eigenvalues of a realization Ak and the 
number of eigenvalues of Ak within spectral gaps of the Dirichlet realization A lD , where = {ij}™ - ■ 

Notations. Sj and H represent complex, separable Hilbert spaces; B(H), Boo(H), and C(H) denote the sets 
of bounded, compact, and closed linear operators in H; dom(-), ran(-), and ker(-) denote the domain, range, 
and kernel of a linear operator, p(-) and cr(-) stand for the resolvent set and spectrum of a linear operator. 
As usual, C°°(Q) denotes the set of infinity diffcrentiablc functions in the domain 0, C§°(£1) the subset of 
C°° (fi)-functions of compact support in 0; Cb(fl) = C(fl) fl i°°(fi), C M (0) the set of uniformly continuous 
functions in f2, C u b{Q) — C„(£l) n C(,(0), and H s (il) the usual Sobolev spaces. 

2. Dual pairs, boundary triples, and operator- valued Weyl-Titchmarsh functions 

Definition 2.1. Let A and A T be densely defined (not necessarily closed) linear operators in ft. Then A and 
A T form a dual pair (DP) {A, A T } in f) if (Af,g) = (f,A T g) for all / e dom(A), g 6 dom(A T ). An operator 
A is called a proper extension of the DP {A, A T }, and we write A e Ext{A, A T }, if A C A C (A T )*. 

Definition 2.2. (cf. [12], [13]) (i) Let $j, Ho, and Hi be complex, separable Hilbert spaces and 

L T = (^Pj : dom((A T )*) -> H © Hi and T = (^j : dom(^*) -^Hi®H 

be linear mappings. Then n = {Ho (B Hi, T T , P} is called a boundary triple for the dual pair {A, A T } if P T and 
r are surjective and the Green's identity holds, 

((A T )*/,$) fl - (f,A*g)si = {Tjf,T g) Hi - (Tj f,T l9 ) Ho , f e dom((A T D, g e dom(A*). 

We set A = (A T )* \ ker(I\[) and Aj = A* \ ker(r ). 
(ii) The operator- valued function Mu(z) defined by 

Tjf z = M n {z)Tlf z , f z ekcr((A T )*-z), z £ p(A ), 

is called the Weyl-Titchmarsh function corresponding to the boundary triple II. 

Due to Green's identity, (A m ; n u, w)L 2 (n) = ( u ,A^ lin v) L 2^ 7 u, v e Cq°(0), the operators A and A T form a 
dual pair {^4, A T } of elliptic operators in L 2 (£l). Any proper extension A e Ext{^4, A T } of {A, A T } is called 
a realization of A. Clearly, any realization A of A is closable. We equip dom(A max ) and dom(A^ ax ) with 
the corresponding graph norms. It is known (cf. [4, 11]) that if a domain £1 is bounded, then dom(^4 m i n ) = 
dom(AT n ) = HQ m (£l), where the norms in dom(^4 m i n ) and Hg m (n) are equivalent. Denote by jj the mappings 
7j : C°°(Cl) — > C co (dQ), "fjU — 7o(9- J u/9n J ) = d^ujdn 1 \ dfl, 1 < j ^ m — 1, 70U = u \ dfl, where n stands for 
the interior normal to <9f2. Next we introduce the boundary operators Bj as 

B J U = H b j/3 jo{D P u), b jf) {-) 6 C*°°(<9ft), ord(Bj) = m 3 < 2m - 1. (2.1) 

Here Bj : C°°(Q) — > C°°(i90) will eventually be extended to appropriate Sobolev spaces H s (il) and in some cases 
to V(A max ). Bj in (2.1) can also be rewritten as BjU = bj^ mj u + Eo^/c^mj-i ^j,k7kU, where bj(-) 6 C°°(<9Q) 
and Tj t k are tangential differential operators in dVL of orders ord(Tj^) ^ rrij — k with C°°(<9r2)-coefficients. 
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With any elliptic operator A (1.1) and a system B — {Bj}™ 1 ^ 1 we associate the operator Ab defined by 

A B = A„ax r dom(l B ), dom(l s ) = H% m {Q) = {u e H 2m (n) \ Bu = 0}. (2.2) 

Our considerations are based on [11, Thm. 2.2.1]. According to this result, for any elliptic differential expression 
A in (1.1) and any normal system {Bj}™^ 1 on dfl given by (2.1), there exists a system of boundary operators 
{Cj}J^T , ord(Cj) = fij ^ 2m — 1, such that the system {B , ■ . . , £? m -i, Co, ■ ■ ■ , C TO _i} is a Dirichlet system of 
order 2m and another Dirichlet system of boundary operators {Bj}™^ 1 U {Cj}™~ , such that the following 
Green's formula hold 

- («.^ T «) ia(n) = E [(^ B 7 w )^(aa)-(^ u ' C 7 w )^ ( an)]' u,v e H 2m (n). (2.3) 

0<J<"»-1 

Next, following [9] and [11], we introduce the spaces D S A (Q) = {u G i7 s (Sl) | G sEl, provided 

with the graph norm ||ti|| D i(n) = (IHl + \\M\l) 1/2 - Clearly, D° A (Q) = dom(A) and D A (Cl) ^ H s (n). 

Definition 2.3. (i) The operator As defined by (2.2) is called elliptic and is put in the class Ell(A) if A is 
properly elliptic on Q and the system {Bj}™ 1 ^ 1 is normal and satisfies the covering condition (cf. [11, Sects 
2.1.1-2.1.4]) at any point of the boundary 9f2. 

(ii) The operator Ab is called coercive in H S (Q) with s ^ 2m if the a priori estimate (2.25) in [2] (cf. also [11, 
Sect. 2.9.6]) holds. 

We note that Ab is a closed operator if B satisfies the covering condition (cf. [2, Sect. 6.5], [11, Thm. 2.8.4]). 

If fl is bounded, then any elliptic differential expression A with C(f2)-cocfficients is uniformly elliptic in Q. 
In this case, A B G Ell(A) if and only if A B is coercive in H 2m (ti) (see [1], [11, Sect. 2.9.6]). If tt is unbounded, 
then the condition Ab G EU(A) is still necessary for coerciveness in H 2m (£l), though, it is no longer sufficient 
without additional assumptions on A. 

Hypothesis 2.4. Assume that A is a uniformly elliptic operator, a a ^(-) G Cb(fl) for \a\ + \/3\ < 2m and 
a a .A-) e C ub (Q) for \a\ + \(3\ = 2m. 

Proposition 2.5. Assume Hypothesis 2.4, Ab G Ell(A), and G p(Ab). Then for any s G K, the mappings 
B and B T isomorphically map Z S A (Q) = {u G D S A (Q) \ A max u = 0} and Z S AT (Q) = {u G D S AT (Q) \ A^u = 0} 
isomorphically onto Uf =1 H s - m ^ ( - 1 / 2 '> (dQ) and onto Uf =1 H s - 2m +^ +( - 1 / 2 '> (dQ), respectively. 

Definition 2.6. ([9, 15]) (i) Under the assumptions of Proposition 2.5, let ip G ITJ 1 ^ 1 H s - m '- < - 1 ^ (dfl), s G M. 
Then one defines P(z)ip to be the unique u G Z A _ zI 2 (Q) satisfying Bu = tp. 
(ii) The Calderon operator A(z) is defined by 

A(z):irj l =0 1 H s - m ^- (1/2) (dQ) -» n^i? 8 -^"^/ 2 ^^), A(*)p = CP(z)p. (2.4) 

(m) Similarly, let V G n™^ 1 J ff s - 2m+ w +1 / 2 (9f7). Then P(z) t t/> is defined to be the unique solution in 
Z s AT _ zI 2 ^ (f2) of B T u = tp and the Calderon operator A(z) T is defined as A(z) T ip = C T Pjip. 

Let Aqq be the Laplace-Beltrami operator in L 2 (dil), — Agn ; i = — Ao^ + /l 2 (90)- Then — Agn ; i = — Ag Q x > 
lL 2 (dn)- Moreover, (— Aqot) -5 ^ 2 isomorphically maps H°(dfl) onto H s (dQ), s G M. Next, we introduce the 
diagonal m x m operator matrices — A^n l m and —Ago i M with the (j,j)-th entry (—Ago 1 )( m 3/ 2 )+( 1 / 4 ) (resp., 
(-A aa ,i) ro - ( ^ /2) - (1/4) ). 

Proposition 2.7. Assume Hypothesis 2.4, A B G Ell(A), and G p(A B ). Set 

Fn,ou = (-Aan^m^Bu, T nA u = (-A dn ^)(Cu - A(O)Bu), u G dom(A max ), (2.5) 
r5 >0 w = (-A^i,^ 1 ^ ^ lV = ( - A 9 oT, m )(C T « - A(0) T B T v) , « G dom^J. (2.6) 
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Then the following holds: 

(i) n = {Han® Han, r n ,r^} ; uritfc 

forms a boundary triple for the dual pair {A, A T } of elliptic operators in L 2 (Q). In particular, the following 
Green's formula holds 

(A max u, v) L 2 (n) - (u, J 4^ ax -y) L 2 (0) = [T n ,iu, TQ fi v) ngn - (T n . u, Tj 21 v) nan , u G dom(A max ), v G dom(A^ ax ). 
(m) The corresponding operator-valued Weyl-Titchmarsh function is given by 

M a ,u{z) = (-A an ,i,/i)(A(«) - A(0))(-A a n,i,m), « G p(l B ). 

In the context of operator-valued Weyl-Titchmarsh functions and elliptic partial differential operators we 
also refer to the recent preprint [6] (and the references cited therein). 

Definition 2.8. For any operator K: dom{K) -► UfS^H-^-^^idfl), dom(K) C HfS 1 H^-^ 1 ^ (dil), we 
set 

A K = Anax f dom(A K ), Aoxa{A K ) = {u G dom(A max ) | Bu G Aoxa(K ), Cu = KBu}. (2.7) 

Definition 2.9. Define S p (Sj) = {T G B^Sj) \ sj{T) = 0(.T 1/p ) as j oo}, p > 0, where Sj(T), j G N, 
denote the singular values of T (i.e., the eigenvalues of (T*T) 1 / 2 ordered in decreasing magnitude, counting 
multiplicity). 

Theorem 2.10. Assume the conditions of Proposition 2.7 and suppose thatO G p{Aq) and K G C(TLqq). Then: 

(i) For any realization A^ G C(L 2 (fl)) of the form (2.7), satisfying p(Afc) fl p(j4s) 7^ 0, i/ie following holds, 

[(A K - zI L 2 {Q) )- 1 - (A B - zh.2 im )- 1 } g S 2Z -i /2 (L 2 (n)], zep(A K )n P (A B ), £eM. (2.8) 

(ii) If B — {Bj}™_T Q is a Dirichlet system, K G B(Han), and p(Ax) H p(A B ) ^ 0, one has 

[{A K - zIl^Y 1 - (A B - zl^)- 1 ] eS^(L 2 (!])), zep(A K )n P (A B ). 

Combining Weyl's theorem with Theorem 2.10 one obtains the following result: 

Corollary 2.11. Assume the conditions of Theorem 2.10. Then, o~ css (Ak) — o~ ess (A B ). 

In the case of elliptic realizations Aq G Ell(A), we have the following stronger result: 

Theorem 2.12. Suppose that the conditions of Proposition 2.7 are satisfied and Aq G Ell(A), that is, Aq is 
the elliptic realization of A with G = {Gj}™! 1 . Then for any /eN, 

[(Ac - zI L 2 {n) )- e - (A B - zI L 2 {n) )- e ] g <Sn^(L 2 (Q)), z G p(A G )n P (A B ). (2.9) 

3. The formally self-adjoint case, nonnegative elliptic operators, and eigenvalues in gaps 

Let A be a formally self-adjoint elliptic differential expression of the form (1.1), that is, A = A T or equiv- 
alently, a Ptq — G C°°(fl). In this case A = A m ; n = A^ in = A J , that is, A is symmetric, and A max = 
(Anin)* = A*. If a normal system {Bj}™" 1 is chosen to be formally self-adjoint, that is, A B = (A B )*, then a 
system {Cj}™^ 1 can be chosen formally self-adjoint too. In this case Bj = Bj and Cj = Cj, and the Green's 
formula (2.3) holds with = Bj and Cj — Cj. Moreover, in this case, \ij =ord(Cj) = ord(Cj) = 2m— 1— rrij. 
It follows that k.dtt,\,p. — Agn.i.m- Hence, Proposition 2.7 yields the following result: 

Proposition 3.1. Let A be a formally symmetric elliptic differential expression and assume that A B and Ac 
are self-adjoint. In addition, assume the conditions of Propositon 2.7 are satisfied. Then: 

(i) II = {Hao, r , Ti} with Hon = TTJ^ L 2 (dil), and Tq^, rn,i defined by (2.5), forms a boundary triple for 
the operator A* . In particular, the following Green's formula holds 

{A max u,v) L 2^ - {u,A max v) L 2^ = (r n> iu, T nfi v) Hgn - (ro ;0 u, ro ; iu) Waf! , u,v G D(A max ). 
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(ii) The corresponding Weyl-Titchmarsh operator is given by Mnji(z) = (— Agn t \ jm ) (A(z) — A(0))(— Adti,i, m )- 

For any self-adjoint operator T = T* e C($j) with associated family of spectral projections Et(-), we set 
K (a,f3)(T) = dim(ET({oi, (3))Sj), — oo < a < (3 (these numbers may of course be infinite). 

Theorem 3.2. Suppose that A > is a positive definite elliptic operator, andU = To, Ti} is the boundary 

triple for A* in Proposition 3.1 with Aq := A* \ ker(Fo) = A~ (D , the Dirichlet realization of A. Assume also 
that the operator A c > is positive definite, e p(A c ). Let K be a densely defined {not necessarily closed) 
symmetric operator in Tign and Ak the corresponding extension defined by (2.7). Then: 

(i) The Calderon operator A(0) is self-adjoint and negative definite, A(0) < 0. 

(ii) If K is A(0) -bounded with bound strictly less than one, then Ak is symmetric (but not necessarily closed). 
If in addition, ran(AT — A(0)) is closed, then so is Ak, that is, Ak G C(L 2 (fl)). 

(Hi) If K is A(0)-compact and self-adjoint, then Ak is self-adjoint Ak — (Ak)* , K(-oo,o)(Ak) < oo, and 

«(-oo,o)(^*:) = K(-oo,o)(^on) + (-A(0))- 1 / 2 X(-A(0))- 1 / 2 ). (3.1) 

(iv) If K is A(0)-compact and sectorial (resp., m- sectorial) with vertex ( and semi-angle uj € [0,n/2), then Ak 
is sectorial (resp., m-sectorial) with vertex £ and semi-angle w too. 

Proposition 3.3. Let A be formally self-adjoint and assume the conditions of Proposition 3.1. Assume also 
that Ak = (Ak)* is a self-adjoint extension of the form (2.7) with K £ C(7i). Then the absolutely continuous 
parts Ak.hc and Ab^c of Ak and As, respectively, are unitarily equivalent. In particular, o^Ak) = cr ac (As). 

Proposition 3.4. Suppose that A = A m - ln is symmetric, and let As = A 1D be the Dirichlet realization of A. 
Assume the conditions of Theorem 2.12 to be satisfied and that Aq = (Ac)* £ EU(^4) is an elliptic realization 
of A with G = {GjY^ 1 . Then the absolutely continuous parts Ac, &c and A lD ^ c of Ac and A lD , respectively, 
are unitarily equivalent. In particular, o- &c (Ac) = 0^0(^70)- 
Finally, we turn to eigenvalues in spectral gaps: 

Definition 3.5. Let A be a symmetric operator in TL. Then (a, (3), —00 < a < (3 < 00, is called a gap of A if 
\\(2A-(a + p)I n )f\\n > (/3 - a)\\f\\ n for all / e dom(A). 

By Corollary 2.11, a ess (AK ) = ctcss(Ab). Therefore, in the gaps of Ab, the point spectrum of Ak can possibly 
accumulate at most at the endpoints of the gaps. Next, we actually show that ct p (Ak) cannot accumulate at 
the left end point of any gap: 

Theorem 3.6. Suppose that the conditions of Theorem 3.2 are satisfied, and that K is a symmetric A(0)- 
compact operator in Hgn- Ln addition, let (a, (3) be a finite gap of Aq = A~ fD and introduce T (z) = A(z) — A(0). 
Then: 

(») T(z) = ToJz) G B^Han) for all z G p(A lD ). 

(ii) There exists e S (0, (f3 — oj)/2) such that EA K ((a,a + e )) = 0, hence H( a ,i3-e)(^-K) = dim(£U K ((a, [3 — 
ejj) < 00 for any e G (0,[3 — a). Moreover, for any e G (0,£o) the following equality holds (with A := A(0)): 

K {a ,(3- E) (A K ) = «(_ oo , )(/w 8n + A- 1/2 (K + T((3 - e))A- 1 / 2 ) - « ( _ oo , )(/w en + A^^K + T(a + e)^ 1 / 2 ). 

Remark 3.7. For Robin-type realizations [du/dn — cru] \ dfl = 0, a G L°°(dQ.), of Schrodinger operators 
—A + q on exterior domains £1 C M 3 , the estimate (2.9) (with t = 1) goes back to the pioneering work by 
Povzner [14]. For Robin realizations A„ of a second-order elliptic operator A = — YTjk=\ a§" a i I fc ( x )gi _ + a ( x )i 
with q > 1, and £",fc=i Sja jtk (x)Z k > for all {x, G x (R" \ {0}), 

" d 

Ac = A max \ dom(A a ), dom(A a ) = {u G H 2 (£l) \ (du/dv — cru) \ dil — 0}, d/du~ ^ a j,k{x) cos(n, Xj)— — , 

i,fc=i k 

a G L°°(dfl), the estimate (2.9) was obtained by Birman [5]. Moreover, in [5, Thm. 6.6] it is also proved that 
K(_oo o)(j4o-) < 00. Thus, for m = 1 and Ak = A a , equality (3.1) with K being a multiplication operator, 
K : u 1— > cru, yields a stronger result as it describes the actual number of eigenvalues in the gap (—00, 0). 
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For positive elliptic realizations Ag of a nonnegative elliptic operator A of order 2m in a bounded domain 
Hct" the estimate (2.9) is implied by a sharp estimate due to Grubb [10, eq. (3.22)]. 

Detailed proofs of these results will appear in [8] . 
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